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The National Education Goals Panel (NEGP) tracks and reports 
annually on 33 indicators linked to the 8 National Education Goals. The 
NEGP's 1997 report showed positive gains on the greatest number of indicators 
for North Carolina and Texas. These gains included significant gains on the 
1996 National Assessment of Educational Progress (NAEP) in mathematics. The 
NEGP commissioned this study to see if the improvements were really 
significant and to try to identify the factors that could or could not 
account for the educational improvement in these two states. The analysis 
confirms that the gains in academic achievement in both states are both 
significant and sustained. North Carolina and Texas posted the largest gains 
on the NAEP administered between 1990 and 1997, and these results were 
mirrored in state assessments administered in the same period. There is also 
that the scores of disadvantaged students improved more rapidly than 
those of advantaged students. Several factors commonly associated with 
student achievement, including real per-pupil spending, teacher/pupil ratios, 
teachers with advanced degrees, and experience levels of teachers, do not 
appear to explain the test score gains. Texas and North Carolina rank at or 
below the national averages on these characteristics, and none of them 
changed during the study period in ways that would explain the gains. The 
study concludes that the most plausible explanation for the score gains is 
found in the policy environment established in each state. Both states 
pursued similar paths to improvement, and each succeeded in changing the 
organizational environment and incentive structure for educators in ways that 
led to improvement. The keys to this change include: (1) creating an aligned 

system of standards, curriculum, and assessments; (2) holding schools 
accountable for improvement by all students,* and (3) support from businesses 
in developing, implementing, and sustaining these changes over time. 

(Contains 16 figures, 4 tables, and 18 references.) (Author/SLD) 
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Exploring Rapid Achievement Gains in North Carolina and Texas 
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Outstanding State Success: North Carolina and Texas are 2 states which: 

• Made greater combined student achievement gains in math and reading (on NAEP, 
1992-1996) than any other states. The gains were significant and sustained. 

• Student achievement gains were mirrored in state assessments administered during 
the same period. 

• Made significant improvement on more measures of progress toward National 
Education Goals than any other states (NEGP 1997). 

These rapid achievement gains were found NOT to be due to: 

• Increased real per pupil spending 

• Reduced teacher/pupil ratios (class size) 

• Having more teachers with advanced degrees or more years of experience 

How did they do it? Three overarching reasons for success were: 

• Leadership from the Business Community 

• Political Leadership 

• Continuity and Stability of Reform Policies Over Time 

What were their Key Reform Policies? 

• State-wide Academic Standards by Grade for Clear Teaching Objectives 

• Holding All Students to the Same Standards 

• State-wide Assessments Closely Linked to Academic Standards 

• Accountability Systems with Consequences for Results 

• Increasing Local Flexibility for Administrators and Teachers 

• Computerized Feedback Systems, Data for Continuous Improvement 

• Shifting Resources to Schools with More Disadvantaged Students 

• Infrastructure to Sustain Reform 




Executive Summary 



The National Education Goals Panel tracks and annually reports on 33 indicators 
linked to the eight National Education Goals. These data points provide a picture of 
individual state’s success in improving education for their children. After an analysis on 
the Goals Panel’s 1997 report, two states — North Carolina and Texas — stood out for 
realizing positive gains on the greatest number of indicators. This included significant 
gains on the 1996 National Assessment of Educational Progress (NAEP) in mathematics. 
The Goals Panel commissioned Dr. David Grissmer to conduct an analysis of education 
reforms in both states to determine that the improvements were indeed significant and to 
seek to identify the factors that could and could not account for their progress. 

The analysis confirms that gains in academic achievement in both states are 
significant and sustained. North Carolina and Texas posted the largest average gains in 
student scores on the tests of the National Assessment of Educational Progress (NAEP) 
administered from 1990 to 1997. These results are mirrored in state assessments 
administered during the same period, and there is evidence of the scores of disadvantaged 
students improving more rapidly than those of advantaged students. 

Nor does it seem that several factors commonly associated with student 
achievement — real per pupil spending, teacher/pupil ratios, teachers with advanced 
degrees, and experience levels of teachers — explain the test score gains. Texas and North 
Carolina rank at or below national averages on these characteristics and none of them 
changed during the period under study in ways that would explain the gains. 

The study concludes that the most plausible explanation for the test score gains 
are found in the policy environment established in each state. Both states each pursued 
remarkably similar paths, and each succeeded in changing the organizational 
environment and incentive structure for educators in ways that led to improvement. The 
keys to this change include: creating an aligned system of standards, curriculum, and 
assessments; holding schools accountable for improvement by all students; and critical 
support from business in developing, implementing, and sustaining these changes over 
time. 

Explaining the Gains 

The report relied on case studies of the two states to identify the policies and 
actions that most plausibly explain the large gains in elementary and junior high school 
test scores in North Carolina and Texas. The case studies revealed a similar set of 
policies in both states that were implemented at times that coincided with the state test 
score gains. Changes in the organizational environment and incentive structure for 
educators emerge as the most decisive aspects of the policies. 




However, similar sets of policies exist in other states. While North Carolina and 
Texas were certainly among the first states to pursue this policy course, their success in 
raising academic achievement is related as much to the way in which the policies were 
developed, implemented and sustained as to the policies themselves. Three elements 
stand out among the latter factors — leadership from the business community, political 
leadership, and continuity of the reform agenda. 

Leadership from the Business Community 

In both North Carolina and Texas the business community played a critical 
leadership role in developing and sustaining reform. Business leaders helped form the 
strategic plan for improvement, forging compromises with the education interests, and 
enabling passage of the necessary legislation. The strategic plans in both states were 
initially opposed by coalitions of education interests, including representatives of school 
boards, principals and teachers. 

In both states, business funded organizations that brought together the business, 
education and policymaking communities. In North Carolina, this began in 1 984 with the 
Commission on Education for Economic Growth and later the North Carolina Public 
School Forum. In Texas in the early 1980s it began with the Perot Commission, and later 
the Texas Business-Education Coalition. Texas business leaders also formed and funded 
Texans for Education, an independent lobbying organization that represented the business 
perspective in education reform. These organizations provided a forum to discuss 
education reform issues and forge compromises among concerned groups that underlay 
subsequent legislation. Developing these systems in both states was a long and arduous 
process, and the business community in both states was the single most stable, persistent, 
and long-term influence for the reform agenda implemented. 

Business involvement was also characterized by the presence of a few business 
leaders who became deeply involved. They took the time to learn the issues in education 
and sustained their involvement for over a decade. They developed knowledge of all 
sides of education issues, became acquainted with decision makers at all levels, and could 
articulate the issues to other, less involved business leaders. 

Political Leadership 

Political leadership in both states was essential at critical points in the reform 
process. During the period from 1984 to 1992, that leadership came from different 
offices — the Governor, Lieutenant Governor, or key legislators. Neither state had 
continuity in party affiliations of key office holders, and both states experienced 
significant turmoil around education issues during this period. Passage of legislation in 
neither state was accomplished on straight party-line votes but rather involved coalitions 
from both parties. The business community remained a consistent external force 
advocating for the reform agenda. 

Since the early 1990s, both states have benefited from the election of Governors 
with education leading their list of policy priorities. Governor Hunt has sponsored many 
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new initiatives to further the reform agenda, including an emphasis on early childhood 
education through the Smart Start program and major legislation to improve the quality 
of instruction and to align teacher education in North Carolina with the state standards. 
Governor Bush has emphasized programs for mastery of reading skills in the early grades 
and a renewed focus on decentralization. 

Such leadership seems essential to build on and maintain the momentum of earlier 
reforms and to help maintain the still somewhat fragile coalitions supporting educational 
reform. Without political leaders willing to build on the foundation of earlier reform 
initiatives, it is difficult if not impossible to create the continuity in the reform agenda 
that is critical to long-term success. 

Consistency of the Reform Agenda 

Efforts to improve education have all too often been examples of reform du jour. 
Over time and changes in leadership the old reform agenda is abandoned and a new 
agenda put forward. In North Carolina and Texas this has not been the case. Despite 
changes of Governors and among legislators, the current incumbents have chosen to 
continue the reform agenda and to find ways to build on and improve it. The on-going 
business support in both states has been an important factor in promoting this continuity. 

The current wave of education reform in North Carolina and Texas is a decade old 
and generating strong evidence that it is working. Acceptance of the new system is 
growing among educators as they realize they can successfully meet its challenges. Most 
importantly, data from state assessments and NAEP show that academic achievement is 
rising for all students. 

The Policies 

The initiatives that led to the new policies began in both states in the late 1980s 
and the policies were put in place in the early 1990s. The main elements include: 

State-wide Standards by Grade for Clear Teaching Objectives 

State-wide academic standards were developed and adopted in both states in the 
late 1980s and early 1990s and supported consistently thereafter. These standards were 
set for each grade and in several subjects. Teachers in all grades were given clear 
objectives for what students should know. In both states efforts were made to align the 
textbooks and curriculum with the state-wide standards. 

Holding All Students to the Same Standards 

Disadvantaged students are held to the same standards as advantaged students. 
Only students with significant learning disabilities are held to their Individual Education 
Plan rather than the state academic standards. Texas statute requires student assessment 
results to be disaggregated by race, ethnicity, and the socio-economic status (SES) of the 
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student. To meet the requirements of the accountability system, each population 
subgroup in a school or district must meet the performance targets. 

State-wide Assessments Closely Linked to Academic Standards 

New state-wide assessment tests were also developed in both states which 
reflected the standards at each grade. Assessment in both states is done in every grade 
from 3 to 8 in reading and math. State-wide testing to these standards began in Texas in 
1993-94 and in North Carolina in 1992-93. The standards and assessments have remained 
substantially unchanged in each year since that time. 

Accountability Systems with Consequences for Results 

Both states rate schools based on their performance on the state tests. Each 
provides monetary rewards for schools based on their test performance. Both states 
reward schools financially for improved performance, and have the power to 
disenfranchise school districts and remove principals based on sustained levels of poor 
performance. The two state systems take into account both absolute levels of test scores 
as well as gain scores. Schools are rated into categories ranging from exemplary to poor 
performing. The gain score is used as the primary ranking mechanism, but schools can be 
penalized if they do not have a specified proportion of students reaching a minimum 
proficiency level. 

Both state systems show awareness of factors that could provide unfair advantage 
to certain schools, including the social and economic advantages of the school 
community. Care is taken in both states to take account of incoming students during the 
year and to adjust beginning gain scores to the actual students in the schools at the 
beginning of the year. Both keep close scrutiny of the students not taking tests. Thus the 
procedures- although not perfect- are designed to try and take account of schools with 
higher student turnover or large numbers of new students with low or high test scores, 
and to protect against manipulation by teachers or principals. 

Increasing Local Control and Flexibility for Administrators and Teachers 

The strategic plans developed in each state in the late 1980s and early 1990s 
acknowledged that teachers and administrators could not be held accountable unless they 
were given authority and flexibility locally to determine how to meet the standards. In 
both states, unnecessarily restrictive statutes governing schools and teaching were 
repealed. The constraints placed on district superintendents and principals for how 
money is spent were reduced. The policy objective was to allow schools locally to vary 
the approaches they could take to achieve the standards. 

Computerized Feedback Systems, Data for Continuous Improvement 

Scores on the test are provided to students, parents, teachers, schools and school 
districts. Both states have a well-designed computerized system of storing the testing 
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information and providing access to it in various ways for teachers, principals and school 
districts. Tests are graded centrally in Texas and in regional locations in North Carolina. 
Access to school level results is provided on the Internet in both states. Both states have 
developed varied formats for reporting test results by sets of questions related to key 
learning objectives. Teachers in both states have access to summaries and individual tests 
of students entering their classes each year. In both states test items are made available 
after each test to the public to counter criticism of bias in test items. 

Shifting Resources to Schools with More Disadvantaged Students 

Both states gradually shifted resources to schools with more disadvantaged 
students. This shift was partially the result of judicial decisions requiring the state to 
fund school districts more equitably. However, the shift may be an essential element of 
achieving a system perceived to be fair and equitable to teachers and administrators. The 
acceptance, endurance and effectiveness of these policies may rest upon the perception 
that the distribution of resources among schools and school districts is fair and equitable. 

Conclusion 

Both states have built a substantial infrastructure for supporting a process of 
continual improvement in education. This infrastructure has been jointly funded through 
the public and private sectors and includes a mix of public, non-profit and private sector 
participation and organizations. This infrastructure includes state focused research 
institutes and centers, organizations primarily devoted to research based policy 
formulation, a network of business-school system partnerships, a developing variety of 
private sector “cottage industries” aiding school improvement with new systems and 
training methods. This infrastructure is supporting a continual process of innovation and 
improvement in the school systems and other support systems for children. 

It includes a continuing series of educational improvement plans- each building 
on previous agendas. It includes continuing analysis and evaluation of the results of 
previous reform. Perhaps the most important part of this infrastructure is the trust, shared 
knowledge and shared objectives that has developed among educators, policymakers and 
business leaders. This trust has developed partly based on the success in lifting 
achievement. But it is also based on a shared experience of working together over many 
years to improve education. 
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Introduction 

The National Education Goals Panel is tracking the progress of states in 
improving the education of their children. States are taking different paths in trying to 
achieve these goals. In the last 10 years, a diverse and unprecedented number of policies 
and programs have been initiated by the states to improve the outcomes of their K-12 
education systems. This diversity can provide a powerful advantage in the long run if 
analyses can identify which of the many different programs and policies are effective. 
Identifying successful programs and policies would enable their diffusion across states 
resulting in more rapid nation-wide progress toward the National Education Goals. 

The National Education Goals Panel has tracked for each state a diverse set of 
indicators related to children’s academic performance, their readiness for school, and 
educational environment since 1991. The challenge to research is to link the movement of 
each indicator to specific policies and programs. A combination of research techniques 
can eventually be brought to this task. A rich research literature can be tapped into that 
has linked programs and policies to many indicators in different contexts. Case studies of 
states that show different rates of improvement can be useful to developing plausible 
hypotheses. Statistical analysis of the data across all states over time for each indicator 
can also help isolate those policies and programs that may be working across several 
states. This analysis can be a complex and uncertain process, but one that should be 
carried out if we are to take advantage of the diversity inherent in our system of federal 
and state governments. 

This report takes an initial step in the direction of trying to systematically link 
movement of indicators with policies and programs. It focuses on one set of panel 
indicators — elementary school achievement scores in math and reading. It chooses two 
states showing large gains in achievement scores from 1990-1997. The states of Texas 
and North Carolina show the largest average gains among states on the National 
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